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Using a one- dimensional macromolecule in aqueous solution as an illustration, we demonstrate 
that the relative entropy from information theory, '^f.Pkin{pk/p1), has a natural role in the en- 
ergetics of equilibrium and nonequilibrium conformational fluctuations of the single molecule. It is 
identified as the free energy difference associated with a fluctuating density in equilibrium, and is 
associated with the distribution deviate from the equilibrium in nonequilibrium relaxation. This 
result can be generalized to any other isothermal macromolecular systems using the mathematical 
' theories of large deviations and Markov processes, and at the same time provides the well-known 

, mathematical results with an interesting physical interpretations. 
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I. INTRODUCTION 



Entropy is the most important concept in both statistical mechanics and information theory. In the latter [Q, 
entropy is a quantity associated with any discrete probability distribution {pk} Q| 

o ■ ^ 

^; s[{pk}] = -J2pk^^Pk (1) 
O 

■ and its generalization to continuous probability distributions is straightforward. In statistical mechanics, the same 

[ Eq. |l| gives the entropy, in units of fc^, for a canonical ensemble of a molecular system at constant temperature. 

O |i This is know as Gibbs entropy. The probability of a molecular configuration, say {xk}, is related to its free energy 

"i I F{{xk}) according to Boltzmann's law P{{xk}) oc e"^^^^''^-'/'^^"^ where fcs is the Boltzmann's constant and T is 

: the temperature in Kelvin It is generally accepted, however, that the entropy in information theory and that in 

^ statistical mechanics, though share the same name, are not the same. 

^ This paper is to demonstrate a second connection between the two fields, both are based on the theory of probability. 

IL" There is another important concept in information theory called relative entropy -ff [{pA;}|{Pfc}]- It is associated with 

, probability distributions {pk} and {pi}: 

X 

k 



d; H[{p,}\{pi}]^Y.P'^^^(fj- (2) 



The relative entropy has many important mathematical properties, for example, it is positive and equals zero if and 
only if Pk — PkJ and furthermore, it is a convex function of pk. 

Until now, however, the relative entropy has not found naturally a physical interpretation in statistical mechanics, 
despite its important role, as a mathematical device, in the stability analysis of master equations Q and Fokker- 
Planck equations In this note, we demonstrate, using two specific examples, that the relative entropy is in fact 
the free energy associated with isothermal equilibrium fluctuations and a generalized free energy associated with 
transient nonequilibrium deviations. The two examples we use are from the recently developed stochastic theory of 
macromolecular mechanics M , however, the generalization of our result is straightforward, and in fact is known in 
mathematical literature |^,^ 

The statistical mechanical system we discuss is a single macromolecule in aqueous solution at a constant temperature 
T. Interest on such system is motivated by the recent experimental studies on single biological molecules [^J^. We 
point out that such systems provide a unique type of nonequilibrium problems in which the momentum distribution 
is in rapid equilibrium due to collisions with the solvent molecules. Hence the nonequilibrium problem is only for 
the conformational, stochastic dynamics of the macromolecule. A separation of the time scales for momentum and 
conformation (over-damped mechanics) is assumed, which leads to the Smoluchowski equation. 
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The Smoluchowski approach to nonequihbrium statistical mechanics of single macromolecules in aqueous solution is 
in parallel and complementary to the approach based on Boltzmann equation for gases and liquids. Both approaches 
are based on Newtonian mechanics, but both invoke a stochastic element a priori in dealing with collisions [ p^ . 
There is an extensive literature on the nonequihbrium statistical mechanics, including studies on relative entropy, 
based on the Boltzmann's framework Q. This work illustrates the approach based on the Smoluchowski's framework 
which is simpler, conceptually straightforward, and applicable to biomolecular applications. We note that the rate 
of uncompensated heat in |^ seems to correspond to the entropy production rate in the Smoluchowski's framework. 
The precise and concrete relation between these two quantities remains to be established . 



II. EQUILIBRIUM FLUCTUATIONS OF A POLYMER CHAIN 



Let's consider a one-dimensional polymer chain with TV identical subunits. Each subunit is an elastic element with 
free energy function (potential of mean force) (f>{x). Let xi, X2, xn-i be the junctions between successive subunits. 
We assume that the end xq = is anchored and the end x^ is freely fluctuating. This model is motivated by the 
mechanical studies on giant muscle protein titin [ p2[ . According to Boltzmann's law, the joint probability for all {x^} 
is 



Peq{{xk}) 



exp 



{Xi - Xq) + 0(X2 - Xi) + ... + (j){xN - Xn-i) 
knT 



(3) 



where 



Z = 



exp 



(^) 



dz 



N 



The partition function of the equilibrium state of such system can be obtained analytically using Laplace transform 
[^,|^. The theory of large deviation of level- 1 serves as its rigorous mathematical foundation j?). 
In a laboratory, usually only xn is observable For this case, we obtain the marginal distribution of @) 



PeqixN) 



poo pOO 

/ ■■■ / Peq{{Xi}) dXi...dXN-l- 

Jo Jo 



(4) 



Combining the probability distribution in Eq. ^ with Boltzmann's law, we obtain a free energy function for the entire 
polymer under the condition that the end of the chain is at a: at 

F{xn) = -ksTlllPeqixN)- 

In a completely parallel fashion, one can obtain the free energy function F{xi, xj) from a marginal distribution of (|^). 

A different type of laboratory measurements is to obtain the density for subunit length. Optical spectroscopy is 
sensitive to the length of subunits, hence it provides a measurement on the density function 



1 ^ 



(5) 



fc=i 



which is known as the empirical measure in the theory of large deviation of level-2 |Q . 

Clearly, the function i'{x) fluctuates in an equilibrium state since {xk — Xk-i) fluctuates. It has an expectation 



E[uix)] ^p{x) 



'<t>{x)/kBT 



For large iV, the fluctuations of v{x) around are so small that one seldomly considers their existence. Nevertheless, 
there is a free energy associated with each v{x), and we now show that 



F \v(x)] - F \p(x)] = NkeT [ i^(x) In (44 1 dx. 

Jo \Pix). 



(6) 



This is in fact a mathematical result for large deviation of level-2 Q]. We give only a heuristic proof below and leave 
the rigorous treatment to the mathematical literature. 
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Let's denote 

(n+l)<5 /.(n+l)<5 

i'{x)dx, and Pn — p{x)dx. 

nS J nS 

Because all the subunits are independent, Vn is a multinomial distribution 

According to Boltzmann's law, the free energy difference between configuration {vn} and {p,i} is 



F[{^n}]-F[{p^}\ = -fesTln 



P{{Pn}) 



NkBTYvn ln( — 



iVfcsT / v{x) In ( ^ ) {5^ 0) 







Therefore, the relative entropy in Eq. ^ is the free energy difference between the distribution {v{x)} and its (equi- 
librium) expectation Relative entropy is the free energy associated with a fluctuating density at equilibrium 



III. NONEQUILIBRIUM RELAXATION OF A POLYMER CHAIN 

Our second example extends the concept of free energy beyond an equilibrium state, and reveals its central role in 
the transient, isothermal, relaxation processes to equilibria. The dynamic model for the polymer chain in an aqueous 
solution at constant temperature T is a Smoluchowski equation 

^ = M:v^P+iv.[VC/(.)P] (8) 
at rj T] 

where ?7 is a frictional coefficient, x — {xi, X2, xn), V — (^gf^, gf^, 97)7) ; ^^'^ 

U{x) — (f>{xi - Xq) + (f){x2 - Xl) + ... + (j){xN — XN-l)- (9) 

ft is easy to verify that Boltzmann's distribution Peq{x) in Eq. ^is the stationary solution to the Eq. In fact, the 
steady-state solution of (^) defines a stationary, time-reversible, stochastic process with equilibrium fluctuations [p^ . 

How is an arbitrary distribution P{x) ^ Peq{x) changing with time and approaching to Peq{x)7 We now show that 
a free energy functional can be introduced, and it is in fact the relative entropy. Let's define a ^'-function 

^[P{x)]= J {U{x)P{x) + kBTP{x)lnP{x))dx (10) 

= -fcsT In Z + keT f P{x) In ( ^^^l ) dx. 

J \Peq[x}J 

The first term is the Helmhotz's free energy of the entire polymer chain in its equilibrium state, and the second 
term should be interpreted as the free energy difference between the arbitrary distribution P{x) and the equilibrium 
distribution Pgq(x). 

The mathematical properties of relative entropy immediately lead to the following statement: The system reaches 
equilibrium if and only if the free energy functional (the ^E'-function) is minimized. Furthermore, if P{x,t) changes 
with i in a transient process according to Eq. |^, then 

i/[P{x, t)] = - j J{x^ t)dx < (11) 

where 
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k T 1 

J{x,t) ^ —VP(x,t) - -VU(x)P(x,t) 

rj 77 

and 

^{x,t) = ~kBTVlnP{x,t) - VUix) 



are fluxes and forces, which are both zero at cquihbrium [|19[. Furthermore, J — P4> and Eq. 11 is related to the 
entropy production rate ||6|, |l8| , ^ . Eq. |l^ immediately leads to a second statement: The dynamic of P{x,t) follows 
a path of decreasing free energy. The free energy functional in ( ]lO| ) is a Lyapunov function |^ for the stochastic 
dynamics of the polymer. The relative entropy is the free energy difference between an arbitrary distribution and 
the equilibrium distribution. It is associated with the nonequilibrium deviation from the equilibrium state. However, 
it is interesting to note that the dynamics does not follow the steepest descent of the free energy functional. The 
interpretation and significance of this observation are not clear to us at present time. We also note that Eq. |ll| 
corresponds to the H-theorem in Boltzmann's framework. 

It is of course not a coincidence that the relative entropy appears as a free energy difference in both the equilibrium 
and nonequilibrium situations. Onsager [ po[ has pointed out that the force driving the nonequilibrium relaxations is 
in fact the same force causing the equilibrium fluctuations to return to its mean. Our result, therefore, firmly relates 
the force to a free energy difference in terms of the relative entropy. 

In summary, we have shown that the relative entropy in information theory has a natural physical meaning in 
equilibrium and nonequilibrium statistical mechanics. It is in fact the free energy difference associated with the 
equilibrium fluctuations of a density function, a result known in the theory of large deviations. In nonequilibrium 
systems, it is the free energy difference between an arbitrary distribution and the equilibrium distribution. Again the 
latter result is known in the theory of Markov processes. What is novel of the present note is to identify the relative 
entropy with the Helmholtz's free energy for isothermal systems. Conversely, the mathematical theorems mentioned 
above become an integral part of the statistical physics of macromolecules. 
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